Local Outlier Detection with Interpretation
نویسندگان
چکیده
Outlier detection aims at searching for a small set of objects that are inconsistent or considerably deviating from other objects in a dataset. Existing research focuses on outlier identification while omitting the equally important problem of outlier interpretation. This paper presents a novel method named LODI to address both problems at the same time. In LODI, we develop an approach that explores the quadratic entropy to adaptively select a set of neighboring instances, and a learning method to seek an optimal subspace in which an outlier is maximally separated from its neighbors. We show that this learning task can be optimally solved via the matrix eigen-decomposition and its solution contains all essential information to reveal which features in the original data space are the most important to interpret the exceptional properties of outliers. We demonstrate the appealing performance of LODI via a number of synthetic and real world datasets and compare its outlier detection rates against state-of-the-art algorithms.
منابع مشابه
Identification of outliers types in multivariate time series using genetic algorithm
Multivariate time series data, often, modeled using vector autoregressive moving average (VARMA) model. But presence of outliers can violates the stationary assumption and may lead to wrong modeling, biased estimation of parameters and inaccurate prediction. Thus, detection of these points and how to deal properly with them, especially in relation to modeling and parameter estimation of VARMA m...
متن کاملContextual Outlier Interpretation
Outlier detection plays an essential role in many data-driven applications to identify isolated instances that are dierent from the majority. While many statistical learning and data mining techniques have been used for developing more eective outlier detection algorithms, the interpretation of detected outliers does not receive much aention. Interpretation is becoming increasingly important...
متن کاملOutlier Detection with Kernel Density Functions
Outlier detection has recently become an important problem in many industrial and financial applications. In this paper, a novel unsupervised algorithm for outlier detection with a solid statistical foundation is proposed. First we modify a nonparametric density estimate with a variable kernel to yield a robust local density estimation. Outliers are then detected by comparing the local density ...
متن کاملSmall Moving Targets Detection Using Outlier Detection Algorithms
Recent research in motion detection has shown that various outlier detection methods could be used for efficient detection of small moving targets. These algorithms detect moving objects as outliers in a properly defined attribute space, where outlier is defined as an object distinct from the objects in its neighborhood. In this paper, we compare the performance of two incremental outlier detec...
متن کاملOnline Detection of Anomalous Sub-trajectories: A Sliding Window Approach Based on Conformal Anomaly Detection and Local Outlier Factor
Automated detection of anomalous trajectories is an important problem in the surveillance domain. Various algorithms based on learning of normal trajectory patterns have been proposed for this problem. Yet, these algorithms suffer from one or more of the following limitations: First, they are essentially designed for offline anomaly detection in databases. Second, they are insensitive to local ...
متن کامل